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e What are Turing Machines 


e Turing Machine Scheme 
e Formal Definition 

e Languages of a TM 

e Decidability 


From Sipser Chapter 3.1 
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e Finite Automata: 


— Models for devices with finite memory 
e Pushdown Automata: 


— Models for devices with unlimited memory (stack) 
that is accessible only in Last-In-First-Out order 


e Turing Machines (Turing 1936) 
— Uses unlimited memory as an infinite tape which can 
be read/written and moved to left or right 
— Only model thus far that can model general purpose 
computers — Church-Turing thesis 
— Still, TM cannot solve all problems 
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Tape 


Turing machines include an infinite tape 
— Tape uses its own alphabet F, with X C I’ 
— Initially contains the input string and blanks 
everywhere else 
— Machine can read and write from tape and move 
left and right after each action 


— Much more powerful than FIFO stack of PDAs 
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The control operates as a state machine 
— Starts in an initial state 


— Proceeds in a series of transitions triggered by the 
symbols on the tape (one at a time) 

— The machine continues until it enters an accept or 
reject state at which point it immediately halts 
and outputs “accept” or “reject” 


— Note this is very different from FAs and PDAs 
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e The machine can loop forever! 
— In this case we say that the TM does not halt for a 
given input 
e Can a FA or a PDA loop forever? 
— NO! it will terminate when input string is fully 


processed and will only take one “action” for each 
input symbol 
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ig Machines 


Design a TM to recognize the language: 
B = {w#w]| w e {0,1}*} 
— Think of an informal description — NOT PALINDROMES 
— Imagine that you are standing on an infinite tape with 
symbols on it and want to check to see if the string belongs 
to B? 


e What procedure would you use given that you can read/write and 
move on the tape in both directions? 


e You have a finite control so cannot remember much and thus must 
rely on the information on the tape 
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‘or B =[w#w|w e {0,1} 
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e M1 loops and in each iteration it matches symbols on 
each side of the # 


— It reads the leftmost symbol remaining and replaces it with “x” 
Scans to the right until the “#” and proceeds to the first non-x symbol 
— Is it the same? 


e Yes! We have a match! We go back to the leftmost remaining 
symbol and repeat 


e No! We have a mismatch =( the TM transition to a “reject state” 
and halts 


If both the symbols to the right and to the left of the “#” are x then we 
have a complete match! Also check same length!!! 


The TM halts and the string is accepted 
e ls looping possible? 


— NO! Guaranteed to terminate/halt since makes progress each 
iteration. 
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q reject 
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e Read “a >b,R” as: if symbol “a” is read on the 
tape then replace it with “b” and move to the 
right cell on the tape 

e For moving to the left would be “a>b,L” 

e We assume missing transitions lead to reject 
State, and the TM halts 
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Input string 011000#011000 

The tape head is at right of the current state 
e,,011000#011000-- 
xq, 11000#011000-- 


X11000#q..X11000-- 
Grey2X L1LO00#K11000-- 
xxq, LOOO#X11000-- 


XXXXXX#XXXXXX daccept > - 
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1 of a Turing Machine 


A Turing Machine is a 7-tuple {Q, 2,1", ô, do Qaccept» Treject} 
where: 

e Q set of states 

e 2 is the input alphabet not containing the blank 

e T isthe tape alphabet, where blank el and2 cI 

e ô: QXT > Q xT xX {L,R} is the transition function 


© qo accept ANA Gyejece are the start, accept, and reject 
states 
— Do we need more than one reject or accept state? 
— No: since once enter either such a state the TM halts 
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The transition function 6 is key: 


-QXT > QxIx {L,R} 

e A machine is in a state q E Q and the head is over the 
tape at symbol a E I’, then after the move we are ina 
state 7 © Q with b ET replacing the a on the tape and 
the head has moved either left (L) or right (R) 
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IS and transitions 


e At any step a TM is in some configuration 
e A configuration is specified by: 
— the state 
— the position (i.e., current location reader head) 
— the symbol at the current head location 
e We say that a configuration C1 yields C2 if there 


if the transition function 6 allows to go from C1 
to C2 
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onfigurations 


Starting configuration: in starting state, head 
position at the beginning of the input 
— Leftmost position of the tape occupied by the input 


Accepting configuration: in accepting state 


Rejecting configuration: in rejecting state 


Halting configuration: either accepting or 
rejecting configurations 

e There can be multiple accepting/rejecting 
configs. but a single accept/reject state 
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Decidable Languages 


The set of strings that a Turing Machine M accepts is the 
language of M, denoted as L(M), or the language 
recognized by M 
— A language L is Turing-recognizable if some Turing machine 
recognizes it 


e |.e., There exists a TM M such that M halts in the accept state for all 
and only the strings s € L 


Halting is not required for s € L, just non-acceptance 


e Turing-recognizable languages are sometimes referred as 
“recursively enumerable languages” 


e ATM which recognizes a language L is called a recognizer for L 
— A Turing machine that halts on all inputs is a decider. 
— Adecider that recognizes a language decides it. 
— A language is Turing-decidable, or simply decidable, if some 
Turing machine decides it. 
e Sometimes referred as “recursive language” 
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ų Decidable Languages 


Remarks: 


— A language is decidable if it is Turing-recognizable and there 
exists a TM decider for it (i.e., a TM thatalways halts) 
— Every decidable language is Turing-recognizable 
e ATM M which decides a language also recognizes it 
e Decidability is strictly stronger property than recognizability 
— Ìt is possible for a TM to halt only on those strings it accepts! 


e It is only a recognizer not a decider 
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e Church-Turing thesis: Anything that can be 
programmed can be programmed on a TM 


e Not all languages are Turing Decidable! 


— Am = {<M,w>, M is a description of a Turing 
Machine T,,, w is a description of an input and T,, 
accepts w} 

e We shall see this in Chapter 4 


e Am is not even Turing-recognizable! 
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Design a TM M2 that decides A = {02" | n20}, the language of all 
strings of Os with length 2". 


e Without designing it, do you think this can be done? Why? 
— Yes: we could write a program to do it and therefore we know a TM 
could do it since we said a TM can do anything a computer can do 
° How would you design it? 


° Solution: 
Idea: divide by 2 each time and see if result is a one 
1. Sweep left to right across the tape, crossing off every other 0. 
2. Ifinstep1: 
— the tape contains exactly one 0, then accept 
— the tape contains an odd number of 0’s, reject immediately 


— Only alternative is even 0’s. In this case return head to start and loop 
back to step 1. 
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on of TM M2 


0000-- Number is 4, which is 22 

x000-- 

x0x0-- Now we have 2, or 2! 

x0x0-- 

xO0x0-- 

xxx0-- 

xxx0-- Now we have 1, or 29 

XxxXxO0-- Seek back to start 

xxx0-- Scan right; one 0, so accept 
r O Ooa 
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ine Example I 


Design TM M3 to decide the language: 
C = {albick]i xj =k and i, j, k 21} 
— What is this testing about the capability of a TM? 
e That it can do (or at least check) multiplication 
e As we have seen before, we often use unary 


— How would you approach this? 


e Imagine that we were trying 2 x3 =6 
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hine Example II 


Solution: 


1. First scan the string from left to right to verify that it is of 
form a*b*c*; if it is, scan to start of tape and if not, reject. 


2. Cross off the first a and scan until the first b occurs. Shuttle 
between b’s and c's crossing off one of each until all b’s are 
gone. If all c’s have been crossed off and some b’s remain, 
reject. 


3. Restore the crossed off b’s and repeat step 2 if there are 
a’s remaining. If all a’s gone, check if all c’s are crossed off; 
if so, accept; else reject. 


* Use different symbols for crossing out the b’s so that is easier 
to restore them =) 
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e So far we have always talked about recognizing a 
language, not generating a language. This is common in 
language theory. 


e When talking about computation this seems strange 
and limiting. 
— Computers typically transform input into output 
— We are more likely to have a computer perform multiplication 
than check that the equation is correct. 
— Turing Machines can also generate/transduce 
— How would you compute c* given aibi and ixj = k 
e In a similar manner. For every a, you scan through the b’s and for each 


you go to the end of the string and add a c. Thus by zig-zagging a 
times, you can generate the appropriate number of c’s. 
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ne Example III 


The element distinctness problem: 


e Given a list of strings over alphabet {0, 1} each 
separated by a #, accept if all strings are 
different. 

° E= {#x,H#x,# ... # x [each x, € {0,1}* and x; # x; 
for each i j} 
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Solution: 


Place a mark symbol on top of the left-most symbol. If it 
was a blank, accept. If it was a # continue; else reject 


Scan right to next # and place a mark symbol on it. If no # 
is encountered, we only had x1 so accept. 


By zig-zagging, compare the two string to the right of the 
two marked Hs. If they are equal, reject. 


Move the rightmost of the two marks to the next # 
symbol to the right. If no # symbol is encountered before a 
blank, move the leftmost mark to the next # to its right 
and the rightmost mark to the # after that. This time, if no 
# is available for the rightmost mark, all the strings have 
been compared, so accept. 


Go back to step 3 
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e All of these examples have been decidable, and 
hence Turing-recognizable. 
e How do we know that these examples are decidable? 


— At each iteration progress is made toward the goal, so the 
goal itself is reachable 

— Not hard to prove formally. For example, if the the input is 
composed by n symbols and a symbol is erased at each 
iteration, the algorithm will finish after n iterations 


e Showing that a language is Turing recognizable 
but not decidable is challenging 


ste 
Theory of Computation - Fall'20 
10/8/20 Lorenzo De Stefani 


